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This paper considers the identification and synthesis of linear sequential 
machines from their state transition tables. Necessary and sufficient con- 
ditions for linearity are derived which form the basis of identification tests. 
A sufficient condition leads to a method for coding the system's state vectors 
in a fashion consistent with linearity but which does not entail trial and 
error. The coding process is analytic in nature and allows the coding of 
state vectors independently of the coding or linearity of the output table. 
Both the Moore and Mealy models are considered in deriving coding pro- 
cedures for the input and output vectors. 

I. INTRODUCTION 

This paper develops a method for identifying and synthesizing 
linear sequential machines using their state transition table representa- 
tion. The basic objective is to construct a procedure which can be 
efficiently implemented by a digital computer. Towards that end, we 
develop simple and easily used preliminary tests which reject non- 
linear systems to precede the time consuming synthesis, or state cod- 
ing, process. The method for the coding of states is completely analytic, 
with the result that trial and error processes are not required. 

Consider the symbolic state transition table, Table I. 

The input vectors, u, have m components (2 ^ M ^ 2'"),* and the 
next state vectors, s ix , and present state vectors, s, , have n unspecified 
components (N ^ 2"). The vector components are defined over a 
modular field, and here this field is taken as GF(2). Most of the results 
obtained below can be easily extended to other prime fields. 

In terms of the state transition table, a linear sequential machine 



*Thia paper considers tables which have at least two distinct columns of next 
states (nonautonomous systems). 
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is defined as a system which changes state according to the equation 

s ix = As { + Bu x . (1) 

A and B are n X n and n X m matrices, respectively.* A linear se- 
quential machine is called fully linear when its symbolic output vector, 
z ix , obeys 

z ix = Cs t + Du z (2) 

where C and D are matrices of proper size. 

When D is the null matrix, the last two equations represent a Moore 
model of the linear system. Otherwise, the equations describe a Mealy 
model. Cohn and Even have given a method for model conversion in 
linear systems. 1 

Table I 

M, U 2 ■ ■ • U T • • • U u 
8] S\i S]2 ' * ' Six • • ■ Si .ir 
S 2 S 2 i S 22 • • ■ S 2x • • • S 2 .\r 

Si Sn S,- 2 • ■ * S 1X • • • S,-.if 

S.v S,vi S\2 ' ' ' S,v z ' " S,v.v 

In recent years linear sequential machines have been studied ex- 
tensively. The motivation for this activity stems from two sources. 
Not only do linear sequential machines exhibit interesting mathemati- 
cal and theoretical properties, but they have found a wide range of 
practical applications; for example, memory addressing circuits, com- 
puting over finite fields, counting and timing circuits, error correct- 
ing codes, encoding and decoding circuits, and generating pseudo- 
random and minimum-time test sequences. 

As persistent research led to greater understanding, several investi- 
gators developed synthesis procedures for linear sequential machines. 
Davis and Brzozowski 2 have reported a method for the synthesis of 
nonsingular systems (systems in which, under each input, every pre- 

*The addition and multiplication operations are modulo 2. Also, the entries 
in all matrices are from GF(2). 
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sent state goes into a unique next state). Their technique is based 
upon an iterative search over partitions of the system states. 

In a mathematically elegant treatment, Cohn and Even 1 have 
derived a synthesis procedure which is free of trial-and-error processes. 
Coded output vectors are used to generate the state vector codes. Not 
only is it necessary that the system have a linear output, but the 
more severe restriction that the output vectors have been given, a 
priori, a linear coding is also required. 

Yau and Wang 3 have disclosed a synthesis technique which does 
not require a linear and coded output. The construction of the A 
matrix by examination of a transition graph, which describes the state 
transitions owing to a given input, leads to the coding of the state 
vectors. The method requires the system to have 2" states. When N < 
2", a sufficient number of "don't care" states are introduced to com- 
plete the state transition table; however, no suitable procedure is 
given for the specification or coding of the "don't care" states. The 
lack of complete freedom from trial-and-error routines is another dis- 
advantage of the method. 

In this paper, necessaiy and sufficient conditions for linearity of the 
state transition table are derived which lead to the development of 
the procedure for coding the state vectors. The method accommodates 
linear systems in general (both singular and nonsingular) . The syn- 
thesis procedure is analytic and, therefore, no trial-and-error routines 
are necessary. Also, the state vectors are coded independently of the 
output table so that the coding process is able to treat systems that 
have linear or nonlinear, coded or uncoded, output vectors. Both the 
Moore and Mealy models are considered in deriving coding procedures 
for the input and output vectors. 

II. NECESSARY CONDITIONS FOR LINEARITY 

Forming the sum of two next states, say s^ and s (y , under the same 
present state, Si , yields 

s iz + s,„ = B(u x + u v ), 

since A{s t + s { ) = ^40 = 0, mod (2). Since the sum is independent 
of the present state, it follows that 

S\x I S lu = S 2x T ^2 V = • • • = Si x T" S|« = • ■ • = 5 A r I -j- g Ni/ 

for each x and y. Let the equality of these sums, for a particular x 
and y, be denoted by the term state sum, and call the individual sums 
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of pairs of next states component sums. For example, the state sum, 
s n + S12 = s 21 + s 22 = s 3 i + s 32 , consists of the component sums s n 
+ S12, s 2 i + S22 and s 3 i + s 32 . 

As a direct consequence of the state sum : if a present state has two 
identical next states, under two different inputs, then the columns 
which correspond to the inputs in question are identical, or the table 
represents a nonlinear machine.* 

The state sums of a linear system must be consistent over all pairs 
of inputs. For example, assume that a state sum contains component 
sums (written in terms of present state symbols) s x + s 2 and s x + s 3 . 
The state sum is consistent only if s 2 = s B ; however, if the output ta- 
ble does not allow the reduction of the state transition table by merg- 
ing s 2 and s 3 , then the state sum is inconsistent and the system is 
nonlinear. 

In order to check state sums over the entire table only M — 1 state 
sums are required. Taking the input Mi as a reference, the state sums 

Sn + Siy = • • ■ = s,i + s,„ = • • • = S.vi + s Nu 
for y = 2, 3, . . . , M cover the table. Since, if s n + s,„ = s n + s iu for 
all y of interest, then for any x 

s ix + s,„ = S,x + s,, + s,„ + s, n 

= s iT + s,, + s,„ + s {1 

= 8 ix + s iu . 
Therefore, it is not necessary to form state sums for all possible pairs 
of inputs. For example, consider Table II. 

Table II 

u x u 2 w 3 u 4 
Si s z s, s 3 s 4 

52 S4 S3 S\ So 

53 S3 S 4 S2 Si 

5 4 Si s 2 s 4 s 3 

From inputs Wi and u 2 , Si + s 2 = s 3 4- s 4 (redundant components sums 
have been deleted) is consistent in the first two columns. From u x and 



* A similar result has been obtained by Davis and Brozozowski a using a different 
approach. 
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W3, s 2 + s 3 = si + s 4 and from U\ and u it s- 2 + s 4 = 81 + s 3 . The last 
two state sums are rearrangements of the first and therefore, the state 
sums are consistent over the entire table. 

Another symmetry feature appears in singular linear machines 
(those characterized by a singular A matrix*). If A is singular, then 
for some present states the rows of next states are identical. 2 This 
follows since a singular A has rank r < n, and therefore, the null space 
of A has dimension n — r, so that .4s, + Bu x = s (J . has more than one 
solution for s { given s lr and u 2 . 

The reduced state transition table of a linear sequential machine 
has additional interesting properties. In what follows only reduced 
state transition tables are considered unless stated otherwise. 

As a preliminary, consider 

Theorem 1: If A is nonsingular, then the reduced table of a linear 
system has an even number of states. 

Proof: If A is nonsingular, under each input, each state will appear 
once, and only once as a next state. Thus, the next state columns are 
permutations of the present state column. As a consequence, each of 
the state sums involves all of the system's states. If the number of 
states, N, were odd, then the same state must appear in two distinct 
component sums of the same state sum. That is, the state sum con- 
tains an equality s. t + Sj = s c + s ( which implies Sj = s e . But this 
contradicts the statement that the state table is reduced. 

Next, a starting result which connects the number of system states 
to the number of distinct inputs* is described by 

Theorem 2: For a reduced, nonsingular, linear sequential machine 
which has N states, the number of distinct inputs cannot exceed 2, if 
N/2 is odd, or 

2 + # J2 2 1 "' 

i-2 

where t is the smallest integer for which N/2* is odd. 

Proof: Consider the state sums associated with the first two dis- 
tinct inputs, i/i and w, . 

S11 + S 12 = s 2 i + s 22 = • • • = s,, + s i2 = • • • = s Nl + s N2 . (3) 

* Common terms from linear and abstract algebra which appear in this paper 
are treated in several texts; for example, see Birkhoff and MacLane. 4 

t«„ is said to be distinct from ?<„ if and only if the columns of next states 
under u z and u» are distinct. 
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Taking Ui with u x , a third distinct input, the following state sum is 
obtained: 

Sit + Six = s 21 + s 2z = • • • = s n + s ix = • • • = s N1 + s iVl . (4) 
Writing segments of equations 3 and 4 in terms of present state sym- 
bols as Si + Sj = s e + s fc = s r + St, = . . . , and s< + s e = % + s jx = 
. . . , respectively, leads to the conclusion that state sum consistency 
requires that equation 4 contain a sum Sj + s k . For if it did not, 
then locating the terms of equation 4, which contains s k , say s k + s t , 
leads to s t + s„ + s k + Si = 0. From equation 3 s t + Sj + s k + s e = 0. 
For compatibility, Sj = sr, so that equation 4 must contain s k + Sj or 
contradict the reduction of the table. It then follows that the state 
sums over distinct pairs of inputs must be mutually derivable via 
component sums. 

Let the component sums obtained from the first state sum from 
U\ and Uo be denoted as follows : 

Si = s u + s, 2 , • • ■ , St = s n + 8 ia , • • • , Sir — Sjvi + s N2 . 

Since there are N/2 distinct sums, let the symbols Si , S 2 , • ■ ■ , S N/2 
denote the distinct component sums. Then equation 3 can be repre- 
sented by *Si = *S 2 = • • • = Sx/2 ■ 

In view of the foregoing, a necessary condition for linearity is that 
all other state sums must be derived from the sums S t , ■ ■ ■ , S N/2 . 
In generating new state sums the &s are paired and the component 
sums which are consistent with equation 3 are formed by transposing 
terms in the resulting equation. For example, pairing *S, and Si can 
yield either of the two equations which do not appear in 3: 

8ii + 8*1 = s,- 2 + 8 a , 

or 

S,i + S,- 2 = 8/i + 8 a • 

Then it is clear that each pairing of the »Ss yields two possible state 
sums. Therefore, the number of unique pairings of the Ss, where each 
pairing occurs only once (this insures that no component sum will appear 
in two distinct state sums), is equal to half the maximum number of 
distinct inputs in excess of the first two. 

Separating the & according to subscript parity gives: 

Oj O3 * • • Ojv/2-1 



S 2 S4 • • • S 



-V/2 
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If N/2 is odd, then one S cannot be paired. Therefore, one sum will 
occur in more than one state sum. Since this is inconsistent with a 
reduced linear table, a system for which N/2 is odd can have only two 
distinct inputs. If N/2 is even, then the number of unique odd to even 
subscript pairings is N/4:. The odd-to-odd and even-to-even pairings 
can be enumerated by considering a single row. It is advantageous to 
transform the subscripts as follows: 

Then, separating the new symbols by subscript parity gives: 

o[ S3 • • " 0,v/4-l 

o 2 04 • • • Str/4 • 

When JV/4 is odd, no pairing is possible. If N/4 is even, the odd-even 
subscript pairings number N/8. Clearly, the odd-to-even pairings of 
the S' can be treated by reapplying the same transformation to the 
subscripts. Therefore, the number of allowed pairings is 

N±2-\ 

i-2 

where t is the smallest integer for which N/2* is odd, if N/2 is even. 
Since each pairing provides for the generation of two distinct columns, 
in addition to the first two columns, the number of distinct inputs is 
2, if N/2 is odd or not greater than 

2 + .V S 2 1 "', otherwise. 

This completes the proof.* 

Theorem 1 leads to a very simple test for the identification of non- 
linear tables. The number of states in the table is used to determine 
the maximum number of distinct inputs. Then, the table is rejected 
as nonlinear if the number of its distinct inputs, or, equivalently, the 
number of distinct columns, exceeds the maximum. Table III illus- 
trates the restriction which linearity imposes upon the form of the 
state transition table. 

There are similar, but weaker restrictions associated with the state 
transition tables of singular linear machines. Consider a system which 
has N states such that each next state column contains d(<N) distinct 
states. (The singularity of the A matrix requires that some rows of 

* A smaller upper bound can be obtained when N 9^ 2". See the Appendix. 
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Table III 

Maximum Number of 
N Distinct Columns or Inputs 

4 4 

6 2 

8 8 

10 2 

12 8 

14 2 

16 16 

70 2 

72 56 

74 2 

76 40 

526 2 

528 464 

530 2 

2086 2 

2088 1568 

2090 2 

2092 1048 

2094 2 

2096 1836 

state transition table to be identical.) If the singular matrix A has rank 
r, then the maximum number of present states which yields the same 
next state (that is, the maximum number of times a row can be re- 
peated) cannot exceed 2 n " r . Since there are iV(^2 n ) states, N2 r ~ n <; 
d ^ 2 r . r t* n implies that each column cannot contain all of the system's 
states so that the reasoning of the last theorem cannot be applied. 
In order to gain some insight into how linearity limits the form of the 
state transition table, consider the case where N = 2". That is, the set 
of state vectors form a complete set of n-dimensional vectors with 
components over GF(2). Let S denote the set of present states, 
(«i , s 2 , • • • , s N ), S lx is denned as the set of distinct next states, (s ls , 
Sax , • ■ • , s dx ) under the input u x , and it is assumed that u x = 0. 
Consider the following 

Theorem 8: A linear system which is associated with a singular A 
matrix of rank r, a null input vector, and which has all states appearing as 
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next states must have at least 2 n-r distinct input vectors, and S ix and S iv are 
either identical or disjoint for all x and y. 

Proof: First, it will be shown that the S lx are cosets of the group 
{ S, + } . Since S is a vector space, 0, s, + s, are members of S for any 
Si , S{ which belong to S. If m, = 0, then the vectors of Su are a subspace 
of S because: 

(i) A(0) = e S u and 
(ii) Ast , Asj e Su implies A(s { + s,-) e Su 

(This follows since s, + s,- = s k e S and As k t Su •) 
The nonull input, u x , generates cosets of the group { S, + } , because 
Bu x is an n-component vector which must belong to S and therefore, 
Su + Bu x = S u ■ 

It is well known that cosets are either disjoint or identical. Since 
e Su > Bu x i Su implies that S xl and S lx are disjoint. Therefore, no 
member of S lt can be used as Bu x if the table is to have a column which 
contains states not found in column 1. If S u and S lx are to be disjoint, 
then Bu x t (S — S n ); that is, Bu z can be selected from a set of 2" — d 
vectors. Continuing, the next distinct coset is associated with an input, 
u v , such that Bu y has not appeared in any of the preceding cosets. 
(If it has, then e Su + Bu v .) Then, Bu v is among 2" — 2d vectors. 
The last unique cosets is generated from a set of d vectors, or 2" — 
kd = d. So that there are k + 1 = 2 n /d unique cosets of next states in the 
table. If each present state is to appear as a next state, the table which 
contains the minimum number of distinct columns must be comprised 
of one column from each unique coset. Since A has rank r, d = 2 r ; 
consequently, there must be 2 n_r distinct inputs. 

Also, since each unique coset can form 2 r distinct columns, the num- 
ber of distinct inputs is not greater than 2", as expected. 

This section has derived several properties that must be exhibited 
by the state transition table of a linear sequential machine. The con- 
sistent state sum requirement will play a central role in the code 
assignment problem. 

in. synthesis: the assignment of linear state codes 

To each symbolic state, s, it is necessary to assign a p-dimensional* 

vector, v, with components over GF(2). That is, s ix -» v {J . 
The vector assignment must preserve linearity; 

v ix = .4^, -f- Bu x . 
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Linear systems must give rise to consistent state sums; therefore, 
the vectors must obey the same sums. Since state sums are only neces- 
sary conditions for linearity, a nonlinear state transition function may 
exhibit consistent state sums. 

For any sequential machine the general state transition equation 
can be written as 

ViI = Av, + Bu x + f u , (5) 

where / to is a p-dimensional vector which is a nonlinear function of 
the present state and input vectors. When the symbolic states obey 
the state sums, (equation 3) , the vectors must be assigned such that 

v u + v lt = v 2 , + v 2u = ■■■ = v ix + v iv = • • • = v N * + v Nv , (6) 
for each x and y. Therefore, from equation 5 it is clear that the non- 
linear function obeys the same restriction, 

/„ + u, = u, + u„= •■• = u* + 1<* = ■■■ = 1»* + fo« • ^ 7) 

The selection of the A and B matrices exerts some control over the 
nonlinear function. When U\ = 0, 

A[Vi | v 9 | • • • | v p ] + [/„ | Ux I ' * ' I /pi] = [ ? '» I v « ' ■ ' I y ">l 
where 

[Vi | v 2 | • • • | v p ] 
is a p X p matrix whose columns are p linearly independent vectors.* 
Then, 

/« -/«-••• - /,- - (8) 

can be achieved by 

A = [»„ | !> 2 , | • • • | W„,][», | v a | • ■ • | »J -1 
Similarly, 

A[Vi | Vi | • • • | uj + B[u 2 | m 3 | • • • | W m +i] 

+ [/12 | /is 1 — I /i.m+i] " [ y ia I y i3 I • • • I »l.»*Jl 

where u 2 , . . . , « ra +i are ??i linearly independent input vectors, yields 
U = U = • • ' = /i.-*i - ° ( 9 ) 

*In cases where the system is singular the matrix of next states (the matrix 
on the right side of the last equality) must be selected so that A has the required 
rank. The rank of A can be determined directly from the repetition of rows in 
the transition table. 
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when 

B = [v i2 + »ii | »» + fu I • • ■ I »t.«+i + Vii][Ui I w 3 | • • • | w m+1 ] _1 . 

Additional constraints on the nonlinear function become clear when 
equation 7 is examined in light of equations 8 and 9. For x = 1, a 
sample equality in equation 7 is 

/.i + /.* = /,. + /,„ • 

When i, j ^ p, j ix = f it = (by equation 8); so that /,„ = /,„ . Equa- 
tion 9 indicates that f t9 » Ofory ^ m + 1, j = 1. Therefore, /,-„ vanishes 
when i ^ p and v ^ ra + 1- Equation 7 implies j ix = /,„ = and j iz = 
/,„ for x, y ^ m -f- 1, * ^ P < j- Finally, /,„ = j ix + /,« when z ^ m + 
1 < y, and j ^ p < i. Table IV below summarizes the restrictions on 
the nonlinear function for systems which exhibit consistent state sums. 









Table IV 






Ml 


u 2 


• u m+ , 


M m + 2 


U M 


V\ 











Jl,m+2 


Us, 


v 2 











constant 


constant 


• 




• 


j 


1 


1 


Vv 











/l .m + 2 


/,.« 


'V+i 


/p+1.1 


oonjUant^ 


/n+1 .1 


Jp+1 .1 T Jl.m + 2 


/p+l.l 1 /l.W 



y .v Jam —> /.\i /.M + /i.m+2 ••• /.vi + /i,w 

A particular code assignment can be verified by comparing state 
transitions along segments of one row and one column with the transi- 
tions predicted by the linear equation. If /,, and / lx are found to vanish 
for p < j I £ N and m + 1 < x ^ il/, respectively, then the code as- 
signment is acceptable. The necessary state transition checks number 
M + N — in — p — 1 (compared with MN — p — m — 1 checks if 
state sum consistency is not verified before a code assignment is at- 
tempted). The implication is that sufficiently large values of m and p 
will force the nonlinear function to vanish over the entire table. While 
it is undesirable to increase m and p (since this requires more memory 



354 THE BELL SYSTEM TECHNICAL JOURNAL, MARCH 1968 

elements) it is certainly possible to do so in principle.* However, in 
computing the A matrix it was convenient to construct a nonsingular 
matrix of p linearly independent vectors. The state sums (equation 6) 
which contain no more than N/2 component sums imply that at most 
N/2 + 1 states can be assigned vectors independently. 

Therefore, not more than N/2 + 1 of the coded state vectors are 
linearly independent with the consequence that it is impossible to 
form a nonsingular matrix of coded state vectors when p > N/2 + 1. 
Where p exceeds this limit it is possible, in some cases, to express some 
elements of the A matrix in terms of the remaining elements. This 
method for finding A is far less attractive than forming a nonsingular 
matrix of coded state vectors; accordingly, the bound p ^ N/2 + 1 
will be enforced. The development which follows demonstrates that 
the limitation on p does not obscure a system's linearity. Similar con- 
siderations lead to m ^ M. 

Turning to the state coding problem, the state sum will play an im- 
portant role in the generation of equations which lead to the linear 
coding of states. First, attention will be concentrated on nonsingular 
systems, then a later section will treat singular systems. 

3.1 Nonsingular Systems 

Consider the sum of two component sums 

v ix + v iy + v ix + v iv = 0; 
it is true that 

A(v ix + v iu + v ix + v iu ) 

= I'ixl + Viyl 4" Vi*l + V ivl + /ixl + /.l/l + fi*l + IjWl 

= 0. 

(The additional subscript indicates that v to is the present state which 
goes into Vw under the null input, Uj.) Taking v ix , v lu , and v ]x among 
the p independent vectors implies /,>i = f w = jw = 0. Furthermore, 
assigning vectors such that 

v ixl + v, yl + w M + v m = (10) 

forces f m to vanish. The sum (10) must be consistent with the state 
sums (that is, no state sum can contain an equality of component 
sums which contradicts equation 10) . 



*When the input vectors are given as coded it is possible to increase their 
dimension by a translation, 
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By similar treatment of all component sums of a state sum, the 
nonlinear function can be made to vanish in the first column (and 
therefore, over the first m + 1 columns) provided that the attendant 
increase in the value of p (owing to the designation of independent 
vectors) does not cause it to exceed its bound. 

If all component sums are treated, it is possible to generate an 
equation of the type 10 in which all four of the vectors have been 
previously designated linearly independent. Clearly, the equation con- 
tradicts the independence of one of the vectors; then, any one of the 
vectors must be deleted from the set of linearly-independent vectors. 
The nonlinear function corresponding to the deleted vector can be 
made to vanish by satisfying the type 10 equation which is obtained 
when the A matrix operates on the generated equation in question. 
Consider the following process for treating a single state sum. 

(i) Select a component sum as a reference sum. Add another com- 
ponent sum to the reference sum. 

(it) Operate on the resulting sum with the A matrix to obtain an 
equation of the type in equation 10. Designate linearly-independent 
vectors as required and mark the vectors for which the associated 
nonlinear function has been forced to vanish. 

(Hi) Verify that the equation obtained in step ii is consistent with 
the state sum and the other equations obtained in ii. If all vectors 
in the equation generated in ii are linearly-independent, delete one 
of the vectors from the set of linearly-independent vectors and repeat 
step ii using the generated equation as the sum upon which A operates. 

(iv) If one of the type 10 equations has three linearly-independent 
vectors, use it as the sum in repeating step ii. Otherwise, add another 
component sum to the reference sum and repeat step it. Repeat ii and 
Hi until an inconsistent equation is generated (the system is no- 
linear) , or until all vectors have been used (the system is linear) . 

The first time the process passes through step ii, three linearly- 
independent vectors are required; in subsequent passes at most one 
additional independent vector is needed. After the first pass through 
the process N/2 — 2 unused component sums remain. Therefore, not 
more than N/2 4- 1 independent vectors are required for the process, 
precisely the upper bound on p. If the state vectors were coded using 
this process, the system would have an undesirably large number of 
memory elements. Therefore, this process is not an efficient design 
procedure. However, completion of the process implies linearity of the 
first m + 1 columns with the result that the A and B matrices can be 
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determined. Linearity of the table over the remaining columns is 
dependent upon the coding of the input vectors. 

As previously indicated, linearity over all of the columns can be 
attained, in the worst case, by increasing the dimension of the input 
vectors. In this case, m = M — 1 would yield a linear system. If it 
is assumed that the input vectors are uncoded, or can be recoded, 
then it follows that completion of the process is a sufficient indication 
that the system is linear. (The problem of coding input vectors is 
treated in a later section.) The process will be referred to as the 
maximum memory process. 

In order to illustrate the maximum memory process consider the 
reduced table, Table V. 





Table V 




1 


Si 


s, s 6 


s t 


S 7 Sg 


S3 


s 5 s 3 


s, 


S2 S4 


Sfi 


S 8 Sj 


8a 


S 4 So 


s 7 


S 6 S\ 


s 8 


S3 -S's 



In terms of the coded vectors the state sum is 

Vi + v 6 = v 7 + v s = v 3 + i> 5 = v 2 + v 4 (11) 

(which is consistent over the table). Using v x + v n as the reference 
sum, 

A(v x + v 6 + v 7 + v g ) 

= /1.0 + /e.o + /7.0 + /s.o + ^1+^4+^0 + V 3 = 0. 

Designating v l} v 0l and v 1 as linearly-independent vectors and satisfy- 
ing the equation 

v v + v, + v 6 + v a = (12) 
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yields 

/i.o =" /o.o = j7.o = Ja.o = "• 

However, vectors v x , i' 8j and v 4 appear in two component suras of 
equation 11, the first and last; this implies 

Vi + v a 4- v 2 + v 4 = 0. 

Adding this to equation 12 leads to v 2 = V 8 . This contradicts the re- 
duction of the table; therefore, equation 12 is inconsistent with the 
state sum. The system is nonlinear. 

As pointed out, the maximum memory process is not a suitable 
vehicle for the economical design of linear sequential machines. The 
process extracts a limited amount of information from the state 
transition table. This can be improved by considering all of the unique 
state sums (that is, from the M — 1 state sums by pairing the first 
input with every other input), and using such equations as 10, which 
the process generates, to better advantage. 

Consider the following procedure : 

(t) Form the M — 1 unique state sums. 

(ii) Select a reference sum from one of the state sums. Add another 
component sum (from the same state sum) to the reference sum. 

(Hi) Operate on the sum with the A matrix. Designate linearly-in- 
dependent vectors as required. Obtain an equation like equation 10 
and verify that it is consistent with the state sums. Mark the vectors 
in all state sums and equations of this type which have been guaran- 
teed a linear state transition under the null input by this step. If all 
vectors in the equation obtained have been designated linearly in- 
dependent, delete any one of these vectors from the set of linearly- 
independent vectors and repeat this step using the equation as the sum 
upon which A operates. 

(iv) In the state sums where at least one component sum has had 
both vectors marked in step Hi, search for a component sum which has 
one vector marked or, search over the type 10 equations for one 
which has three terms marked. If such a component sum or equation 
is found, use it in repeating step Hi. (Since three of the vectors make 
a linear transition, the nonlinear function which is associated with 
the fourth vector can be made to vanish in step Hi without designating 
another linearly-independent vector.) Otherwise, 

(v) If the sum of the type 10 equation is unique and has two vec- 
tors marked, then use it in repeating step in. Otherwise, 
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(vi) Form a new sum for use in step Hi by adding the reference sum 
to another component sum (from the same state sum). Repeat step Hi. 

The process is repeated until all of the vectors have been marked 
in step Hi (the system is linear) or until an inconsistent equation is 
generated in step Hi (the system is nonlinear) . The coding process for 
the state vectors is initiated by assigning arbitrary, but linearly in- 
dependent, vectors to the state vectors so designated by passes through 
step Hi. The remaining state vectors are coded using the type 10 equa- 
tions which were generated in step Hi in conjunction with the state 

sums. 

The application of this synthesis procedure is more straightforward 
than its description would indicate. This is best illustrated by an 
example. Consider Table VI. 





Table VI 









(o) 


6 


«i 


So 


8< 


s 2 


s 2 


s, 


S3 


Ss 


S 3 


S a 


s 7 


s 6 


Si 


s 3 


Si 


s 5 


«5 


s t 


S a 


s 7 


S a 


s 5 


s 8 


s 3 


S 7 


s 8 


s 8 


s, 


S 8 


s 7 


8 a 


s 4 


So 


Sn 


Si a 


S 9 


$10 


$9 


• s 'in 


s,, 


S,i 


Sio 


So 


Si2 


Si 2 


Si 2 


s„ 


Sio 



In terms of the coded vectors, the state sums are: from inputs (J and 



v 6 



+ v 4 = Vi + v 3 = Vi + v 7 = v 5 + Vg = l>n + ^i2 = f + Wio , (13) 
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from inputs ( j and ( ) 



V 6 + V 2 = V 1 + V & = V 3 ~\~ V s = V 4 + V-! = v n + v = v l0 + v 12 . (14) 

Equations 13 and 14 are mutually consistent, and both are consistent 
over the table. 

The observation that Av 12 = v V2 leads to the assignment of the null 
vector* to t>i 2 (therefore, /io,o = 0). Then in step ii of the synthesis 
process, take V\\ + v i2 of equation 13 as the reference sum, and add 
it to i> 5 + v s of equation 13. In step Hi form 

A(v 12 + v n + v 5 + v s ) 

= /l2.0 + /ll.O + /s.O + /s.O + t>12 + ^10 + V 4 + y 7 . 

Since f 12l o = 0, taking v xl and t> r , among the linearly-independent vec- 
tors and the satisfying equation 

v u + v 10 + v 4 + y 7 = (15) 

leads to f llf0 = / 5 ,o = /s,o = 0. Also, the set of vectors for which the 
nonlinear function vanishes, denoted by L, is 

L = [v la , y„ , w 8 , v 5 }. 

Equation 15 is the sum of two component sums of equation 14. There- 
fore, equation 15 is automatically satisfied. 

At this point, component sums do not satisfy the conditions of step 
iv. In step v equation 15 is not unique. In step vi taking v 2 + v 7 with 
the reference sum yields 

A(v 12 + v u + v 2 + v 7 ) 

= /12.0 + /ii.o + /2.0 + /7.0 + V la + 1' 10 + Vi + V s . 

Since / 12 ,o = /n.o = 0, designate v 2 as a linearly-independent vector. 
Then, 

/2.0 = /-,o = 
if 

»12 + fio + i'i + *>a = 0. 
The last equation is a rearrangement of terms in state sum (14) and 
therefore it is automatically satisfied. 



* The assignment of the null vector is somewhat arbitrary. It has been shown 
(Yau and Wang a ) that the null vector can be assigned to any state which is 
mapped into itself under the null input. 
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Updating the set L, 

L - [v ia , v u ,v s ,v 7 , v 5 ,v 2 }. 
The conditions of steps iv and v are not satisfied; in step vi, adding 
v x + i> 3 and the reference sum yields 

A(v l2 + u u + v t + v 3 ) 

= /.2.0 + /ll.O + /i.o + /3.0 + V la + V, + ^6 + V 2 . 

Since /i 2 ,o and j n ,o have been shown to vanish, including Vi among 
the linearly-independent vectors leads to 

/1.0 = /3.0 = 
if 

Via + »io + v o + v 2 = 0. 
The last equation is the sum of two component sums of equation 14. 
The set L becomes 

L = {v 12 , v n , y H , v 7 , v 6 , y 3 , v 2 , i>, } . 

In equation 14, Vi + v 8 , and v 3 + i> 5 have both vectors marked in 
step Hi while v 6 + v 2 , v 4 + v 7 , v u + v» and Vi + v 12 each have one 
vector marked. 
In step iv, forming 

A(v t + Vs + "o + v 2 ) = /,. + /s.o + /o.o + /2.0 + v a + y 7 + y 5 + Vi . 
Since / lt0 , /a.o, and / 8 ,o have been shown to vanish, / 0|0 = if 

v 6 + v 7 -\-v 6 -\-v 1 = 0. (16) 

Equation 16 is unique and consistent with the state sums. 

L = {v 12 ,v 11 ,V( t ,v 7 ,v 6> v 5 ,v 3 ,v 2 ,v i }. 

Proceeding more quickly, A operating on Vj_ + v 8 + v 4 + v 7 (from 
step iv) yields / 4 ,o = and 

v a + v 7 + v 3 + v s = 0. (17) 

The last equation is unique and consistent with the state sums. Up- 
date the set L; let A operate on v x + v s + Vn + v Q (from step iv) to 
obtain / 9i0 = and 

f e + v 7 + v 10 + Vn = (18) 
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Equation 18 is unique and consistent and also has three vectors in the 
set L. Update the set L. 

From step iv, A{v 6 + v- + v l0 + Uu) yields /i ,o = and v 5 + v% 
+ Vq + v 10 = (which is the sura of two component sums of equation 
14). Update the set L. Step iv gives v u + v i2 + v 9 + v i0 which, when 
operated on by A, yields 

Zio.o = and v 10 + v 13 + r,, + w 8 = 

(which is the sum of two component sums). L contains all of the 
state vectors ; therefore, the system can be coded. 

There are four linearly-independent vectors (p = n = 4). Make 
the following assignment of the linearly-independent vectors: 



I',, = 



v, = 




1 






v, = 



Since v, 2 = 



, all of the component sums in equation 13 equal 



0n + Vis = 



Then, from equation 13 it follows that 



Us = l'o + 



(l 




I 1 







1 










0. 




i0 



v 7 = v 2 -\- 



(l 




f l 















1 











and 



v 3 = t>i + 



(Y 




r l] 






= 






,0, 




.1. 



362 THE BELL SYSTEM TECHNICAL JOURNAL, MARCH 1968 

Similarly, the component sums in equation 14 are each equal to v g -\- 



Vn = 



with the result 



V e = v 2 + 



>'., = v 7 + 



V 9 = »n T 



l>10 = "12 + 

To calculate A consider 

A[v u I v B I v 2 I ^i] = [»io ! v t I Vi I v n ] 



1 
1 
1 

UJ 


1 
1 
lj 



1 

IX 



r -1 1 


1 





1 



X 


1 



i 








o~ 







1 








= A = 








1 
















i_ 





1 








ll 


1 


1 





1 





1 





1 


1 


1 


1 


1_ 



The matrix B satisfies 



B 



1 

1 



= [l' 4 + l'r, I r, + v n ] , 
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with the result 



"l 


ll 





1 











1 



B = 



Since equation 16 and 18 are consistent with the state sums and 
since they were not used in the coding process, they are redundant. 
It is easy to verify that the equations are satisfied by the code 
assignment. 

The process produced a code assignment for which the coded state 
vectors had the minimum number of components. This will not be 
true for all tables. Considering the way the process extracts infor- 
mation from the table leads to the conclusion that the attainment 
of the minimum component coding vector depends upon the con- 
nectivity of the sequential machine. In a case where the machine is 
not strongly connected there is a possibility the process will require 
p > n* (The last example involved a machine which was not 
strongly connected.) In order to illustrate this consider Table VII. 

Table VII 



s 2 


8] 


8 a 


Sio 


s fl 


Sio 


s 3 


S 2 


Si 


Su 


Sio 


So 


Si 


s 3 


Si 


s 12 


s 12 


Su 


8$ 


Si 


S a 


S\z 


Su 


Sis 


So 


Sa 


•% 


s u 


Sis 


Su 


s 7 


Ss 


8s 


Sis 


S13 


Sie 


N S 


Si 


St 


Si6 


8 l B 


Sis 



The coded vectors obey the state sum: 

v A + v 6 = Vi + Pa = ''2 + ''7 = v s + v s 

= V n + V l2 = V + Ii 10 = V 13 + V 16 = V 1A + «is • 



(19) 

* A sequential machine is said to be strongly connected if it is possible to reach 
any state of the system starting in any initial state. 
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Taking v U \ = leads to the seection of v 18 + v 19 as the reference 
sum since it is an advantage to exploit the fact that /, 8 ,o = 0- For 
brevity, the results obtained from step Hi of the synthesis process are 
shown in Table VIII. 

Table VIII 

Additions to 
The Set Linearly 
The Sum A Operates The Equation L Inde- 

Upon Obtained pendent 

V a + v i3 + v a + v l6 v ia + v 7 + v lt + v 4 = v 1G , Via , v a , v s v s , V 1S 

Via + v 7 + Vi4 + v 4 v l6 + v 8 + v 3 + v l5 = v u ,v 7 ,v t v 7 , v u 

V ia + ^13 + V + V 4 V 16 + V U + V 5 + V 3 =0 V a 

Via + ^13 + ^14 + ^15 Via + ^14 + *>13 + *>15 = V 16 

V,a + V i3 + V 7 + V 2 Via + Vu + V 1 + ?; 8 = V a 

^io + ^14 +^1+^8 *>ie + V 15 + Vq + y 7 = *'i 

Vie + l>13 +^1+^3 *>16 +^14+^6+^2 =0 V 3 

At this point it is observed that t>„, v lQ , v u , and v i2 are not in L, 
and more importantly, it is not possible to involve these vectors in a 
relationship by application of step Hi without introducing another 
linearly-independent vector. By continuing the process it can be 
demonstrated that the system is linear. 

A(v l6 + i» la + v u + v l2 ) yields /,,.„ = /,,.u 

when 

''io + »m + ^io + v 12 = 0. (20) 

Then, A(vi Q + v u + ^10 + ^12) leads to / 10 .o = /12.D 

when 

Via + ''is + v l2 + V 9 = 0. (21) 

A, operating on the last equation, gives /»,o = /i2,o 

when 

Via + v l3 + ^12 + ^11 =0 (automatically satisfied). (22) 
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The system is linear since designating v 12 as a linearly-independent 
vector leads to 

/12.0 = /o.o = J10.0 = /11.0 = "• 

It is also of interest that the set L which was obtained by the process 
can be coded using the four linearly-independent vectors. This will 
be true in general. 

In order to insure realization of the transition table with the least 
number of memory elements, it is important to develop a means for 
keeping p at its minimum value, n. First, a general method for the 
reduction of the number of vector components will be developed. Then, 
the method will be applied to the problem at hand. 

Let the set L n denote the largest set L generated by the synthesis 
process using n linearly independent vectors; let L n denote the set of 
vectors which require additional linearly independent vectors in order 
to become members of L. The n-component vectors y are members of 
L„ , and the n-component vectors y are in L n . 

The members of L„ can be coded. Taking the first n vectors of L„ as 
linearly independent (since order is unimportant), the calculation of A, 
after the coding, leads to 

A[y t I lh I • • • I Vn] = [iJlO I 2/20 I • • ' I Vnol 

This can be simplified by coding the linearly-independent vectors such 
that [?/i I y 2 I • • • I Vn] = In (the n X n identity matrix). Then, 

A = [jho I 2/20 I • • • I 2/no]- 

Suppose the set L n+l is tentatively formed by designating another 
linearly-independent vector. It is clear that the vectors in L n+I (and 
L n+1 ) have n + 1 components. In order to preserve the coding of L n 

take ( y ) t L n+ i where y c L n . That is, the vectors which have been 

coded over n linearly-independent vectors are increased by one com- 
ponent (which is taken as zero. Members of L n which become members 

of L n+1 will be denoted as ft J. Let P" +1 j denote the (n + 1) lh linearly- 
independent vector where ?/ nM is any coded vector not in L n . The 
(11 + 1) X (n + 1) matrix A is given by 

1 







Vn 





2/n+l 

1 



J 



2/10 





2/20 




1/nO 




2/n + l.O 
1 



* If y n+ i and ijn+i. are in different sets (/.„ or L„), then the known A matrix can be 
used to determine the coding of the vector which is in L„ . 
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From the previous coding of L n , it follows that the left side of the last 
equation can be written as 

Lo I i J 

Therefore, it can be verified that 

r [A 1 Ay n+1 + y,+ i.o l (9 n\ 

A = Lo"| i J' {d) 

Observe that if A has the form 

* - [f It] ■ 

then A operating on any vector which has the form MM will yield a 

vector of the same form. Similarly, all vectors MM are mapped into 

another vector where the last component is zero. Since all of the n 
component vectors y (of L n ) and all n component y vectors have different 
codes, then the last component of the vectors in L n+1 can be deleted. 
Also, the matrix A (in equation 23) is the required matrix. 

In view of the foregoing, a code transformation, acting on the coded 
y, must be found such that A has the form of equation 24. It is well 
known (for example, Cohn and Even 1 ) that the code transformation 
y' = Ry, where R is a nonsingular matrix, cannot alter the linearity 
of a system. From the state transition equation 1 it is easy to show that 
this type of code transformation produces a new matrix of the form 
RAR-\ 
It is required to find an R such that 

RAR- 1 = [f\{\- (25) 

Comparison of equations 23 and 24 indicates that R must have the form 

R - [i|fl. (26) 

Using equation 26 in equation 25 leads to the following restriction 
on the vector T: 

Ay n+1 + g n+l , ~(A + I n )T. (27) 
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*')• 



and 



*m = 



9 + ? 

y -\- T cannot be a member of L n if the (n + 1) th component is to be 
deleted. 

Therefore, the process of reducing the vector components by one is: 

(i) Determine the vectors T which satisfy (27). 
(ii) Of the vectors obtained in i, select one which preserves the 
identity of L„ . 

Returning to the example, it can be verified that the following is an 
acceptable code for all of the states except y n , v 10 , v n , and v 12 : 



v n = 



v,, = 



/'■> = 



i'i = 



r, = 



v 8 = 



*'.i = 



''ia = 



Vs = 



and 



The corresponding A matrix is 



A = 









l 


o" 








l 


1 


1 


n 


n 





1 


i 





lj 



The set L t is }v , ^'io , v u , v 12 \. Set v equal to any vector not in L 4 , 
for example 
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Vg = 



1 



1 



From the table v 9f0 = v n . To determine v u , add equations 21 and 
22. The result is 



^11 = ^9 + ^15 + v l3 = 



1 

1 

ll. 



Then, 



AVq + t'9.0 = 



1 ol 


fl] 




[l] 




o] 


11 





+ 





= 


1 


10 


1 




1 







1 I 1_ 







1, 




.0. 



and 



A + I 4 = 



Substituting in equation 27 yields 



10 10 
111 
10 10 
110 



1 1 ol 




o] 


111 


T = 


1 


10 10 







110 0^ 








An acceptable solution is 



T = 
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since the new v 9 , 



equations 20 through 22, 



ll 




o] 




'll 















1 


+ 





— 


1 


0. 




1. 




1 



, is not a member of L 4 . From 



''•. = 



, and y, 2 = 



It can be verified that this is an acceptable coding. 



3.2 Singular Systems 

The synthesis procedure which was developed in the last section 
can be readily extended to treat the coding of singular systems. 

Consider a state transition table that has d (d < N) distinct rows. 
For linear systems, tables of this type have columns of next states 
comprised of sets of d distinct entries. Therefore, the state sums 
(with respect to the first column) have the form 



+ »i. = 



= »<i + V IZ = • • • = Vji + o, u , 

for x = 2, 3, ■■■ ,M. (28) 

In general a given table can have columns that are disjoint sets of 
states. Also, when 2d < N, these columns can generate state sums such 
that the only state vectors two state sums may have in common are 
from the first column. State sums of this type will be called distinct 
state sums. 

An attempt to apply the synthesis algorithm of the last section 
to a table which has distinct state sums can lead to undesirable 
results. Since the equations determined in step Hi of the algorithm 
can contain only the d distinct vectors of the first column, and since 
all state vectors must be guaranteed a linear transition to column 
one, it is clear that in step iv at least one linearly-independent vector 
must be designated for each distinct state sum. As a consequence, a 
system coding that requires a large number of components may re- 
sult. In order to avoid this situation it is useful to introduce the 
concept of independent inputs. 

The set of independent inputs is the set of input vectors that spans 
all of the input vectors. That is, if u- 2 , . . . , u„, + i are the independent 
inputs (the set of linearly-independent input vectors) , then any other 
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vector, say u„ , can be written as 

m + l 

U u = 2J a u* u * > 

x = 2 

where the a yx are constants which can be arbitrarily assigned when 
the inputs are uncoded, or they can be determined by inspection of 
u„ when the inputs are coded. 

Recall that Bu„ = v iy + v n , for any i; allowing B to operate on 
the expansion for u„ yields 

m + l 

v iy + v tJ = £ a„(v j{a)s + »«.)i)i ( 29 ) 

j- = 2 

where each j(x) can assume any row index. 

The state vector v iy can be forced to make a linear transition under 
the null input if all vectors in column one and all of the v i{x) x have 
been guaranteed a linear transition in step m, and if (29) holds. To 
demonstrate this, use the A matrix to operate on the sum of v. iv + v n 
and another component sum; then, compare the result to that obtained 
by repeating the operation after v iu + v n has been replaced by its 
expansion. The equations of the type (10) which are generated are 
required to meet the conditions of step Hi. Since each distinct state 
sum not associated with an independent input can be treated in this 
way, these state sums meet the conditions of step iv without the desig- 
nation of a linearly-independent state vector. Also, since all vectors 
in column one make linear transitions, all other vectors in the state 
sum can be treated via step iv. 

After the independent inputs have been identified (for coded inputs) , 
or designated (for uncoded inputs) the synthesis procedure of the last 
section* can be applied over the state sums associated with inde- 
pendent inputs. The remaining vectors could be treated by employing 
equations of the type (29) and entering the synthesis process at 

step iv. 

A modified synthesis procedure of this nature would require con- 
sideration of the equations of the type (29) in the coding process. 
The modifications are compatible with nonsingular systems. 

The remainder of this section develops an alternative synthesis 
procedure that is better suited to capitalize on the redundancies found 
in transition tables of singular systems. 



* It is necessary to provide for the selection of another distinct state sum 
after all component sums of the state sum under consideration have been ex- 
hausted. This can be accomplished by selecting the reference sum in step vi from 
another state sum. 
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When, for example, columns 1 and 2 are disjoint sets of states, 
(28) contains 2d distinct vectors. It is asserted that the 2d vectors 
of this distinct state sum can be coded over the r + 1 components 
(where r is the rank of the A matrix) by a modified form of syn- 
thesis procedure of the last section and that the remaining vectors 
can be coded by a simple relationship. Since only one distinct state 
sum is to be considered, the information concerning the designation 
and deletion of linearly-independent vectors (in step in) which is 
implicit in the other state sums must be incorporated. This is readily 
accomplished by generating equations of the type (10) over the re- 
maining state sums and equations like (29). Then, the unique equa- 
tions, which must be compatible with state sums, are used to augment 
the state sum; that is, these equations, as well as the state sum, are 
used as state sums in coding over r + 1 components. (Notice that the 
equations in question contain only vectors from column one.) 

Partition the vectors such that the upper partition contains r + 1 
components. That is, 



i'it = 






Then, using the augmenting equations, 

»i'i + W12 - • • • = v'n + v'<2 = ■■■ = r! n + v' d2 

and the state sums formed by columns which may appear in the table 
that are permutations of the first or second columns in the synthesis 
process, will yield a coding of these vectors and an (r+l)X(r+l) A 
matrix. Let A' denote this matrix of rank r. The relations 



from Section n) and 



imply 



N2 r ~" < d < 2 r 



2""' < N < 2" 



2 r <2d£2 r+1 (30) 

which verifies that r + 1 components are required to code the vectors 
in the first two columns. 

Before continuing, it is convenient to separate the present states 
into sets such that all members of a particular set give rise to identical 
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rows of next states. Let V f denote the set of present states which are 
associated with the j th row. If one or more members of the set has been 
coded over r + 1 components, then select one such r + 1 component 
vector as the characteristic vector of the set. Denote it by the symbol 
cv'j . If no vector in V f has been coded over r + 1 components, the 
characteristic vector can be determined from 

A'co\ = ?>;, . 

This last equation has at least one solution for cv\ since the columns of A' 
must span all of the v' vectors of the first column. Also, the cv' so deter- 
mined is not a characteristic vector of any other set. Then, taking the 
system A matrix (n X n) as 



A = 



I"— 1-1 

Lo | oj 



will make the linearity of the transitions in the first column depend- 
ent only upon the coding over v'. For the vectors which have been 
coded over v', set the remaining components, the v", equal to the 
n—r—1 component null vector. (This is necessary, if u x = 0.) That is, 

y /( = v » = for i = 1,2, ■■■ ,d. 

Thus, all vectors in the first two columns are completely coded. 

The remaining vectors can be coded by the following process. Con- 
sider the column of uncoded vectors under an independent input u„. 
From the state sum of u x and ii y , it follows that 



= v, 



+ v la + v„ , for j = 2, 3, ••• ,d. (31) 



Since v n and v n are known, once v lv is coded, the coding of all other 
vectors in the column is determined by equation 31. v' u can be set equal 
to the characteristic vector of the set V in which v lv (as present state) 
belongs. This will insure that the present state v lu makes a linear transi- 
tion under input u x . v[' u can be set equal to any n — r—1 component 
vector that has not been previously used as a v" vector. When w„ is 
not an independent input, v ly can be obtained from equation 29 after 
the independent inputs have been treated; then equation 31 gives the 
the coding of the remaining vectors in column y. 
To illustrate the process consider Table IX. 
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Table IX 



[o 




I 1 














o) 












1 




1 







0. 









0, 




1 




1. 



s 4 
So 

s 7 
s 8 
s„ 

The state suras are 



s, 
s 2 
s, 
s 2 

•s, 
s 2 

Si 

.s, 

S! 

.S'., 



s 3 

S< 

s 3 
s 4 
s 3 
s 4 
s 3 
s 4 

«:» 
Sj 



So 
Ss 
S« 
S 5 
Sa 

s 5 
s a 

■ s '.-, 

Sfl 



s 7 
s 8 
s 7 

•Ss 

■s 7 

■Ss 

S7 
s 8 
s 7 
s« 



•Sy 

Ski 

•So 

s io 

-Sy 

Sio 

89 

Sio 

s 9 

•Sin 



Vj + ?> 3 = V 2 + f 4 , 

«'i + V 6 = ^2 + V<i , 

i', + "7 = v 2 + y s , 
«'i + ''•• = w 2 + v ln . 

The state sums are consistent over the table. Take the second, third, 
and fourth inputs as independent. All state sums and equations like 
(29) generate augmenting equations identical to the null vector. To 
determine r, note d = 2; therefore, from equation 30, r = 1. The vec- 
tors in the first state sum are coded over two components using the 
synthesis process. The result is 



and 



Lo 0. 
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The sets V are: 

Vi = [y, , Pg , v s , v 7 ,v 9 ], 

V 2 = \v 2 , v 4 , v 6 , v 8 , v l0 }. 
The characteristic vectors are taken as v[ and v' 2 , respectively; that is, 



cv\ = 



and cv' 2 = 



The vectors in the first two columns are fully coded by setting the 
last two components of each vector to zero: 



and 



From the second state sum, 

^ 5 = v\ + v 2 + y • 
Take 
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"2 = 
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Va 
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.0 
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,0, 
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A = 
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_0 








0_ 









Since t> (! e V->, 



therefore, 



v' a = cv' 2 = 
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and 






1 




1 




0^ 


















+ 


1 


— 


1 


.0 




A 




.0. 



Similarly, taking 



and observing that 



Vb = cv!, and v 7 = i\ + v 2 + v, 



lead to 



»a = 



and v 7 = 



respectively. Since the last input is the sum of the third and fourth 
inputs, V\ + v = Vi + i» 6 + Vi + v 7 . Then, 



fg = 







UJ 



and ?; 10 = 



Finally, 



H = 



r° 





0~| 


i 











1 











1_ 



IV. CODING THE OUTPUT VECTORS 

4.1 The Mealy Model 

Let z ix denote the symbolic output vector for input u z and present 
state s, . Let the output table contain L distinct vectors; then, z, x is an 
Z-component vector (L ^ 2') over GF(2). A fc-dimensional vector 
(I ^ k), Wi f , is to be assigned to each symbolic output vector, 
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If the output is linear, 

Wta = Cvi + Du t . (32) 

This equation implies that all of the equations obtained in terms 
of the coded state vectors (state sums and equations derived in the 
coding process) can be converted directly into relationships involving 
the coded output vectors. For example, if Vt+Vo = v 3 +v 4 , then from 
the output table, for any u y , 

w lv + w 2ll = w 3v + w 4u . 

Let the equations obtained in this way be referred to as state derived 
equations. 

From equation 32 it follows (by the same reasoning leading up 
to equation 6) that 

u> u + w ly = ■ • • = w iz + w iv = • ■ • = Wifi + w Ny . (33) 

Such equalities will be denoted by the term output sum. 

Clearly, output sums, and state derived equations must be con- 
sistent if the output is linear. 

It is known that N = 2" for a reduced table of a fully linear sys- 
tem.* Therefore, if N < 2* for a reduced table, the output is non- 
linear. On the other hand, where N = 2 n , the set of coded state vectors 
forms a complete set of n component vectors. Then, when I > n and 
there is a null input, say t<i , it is easy to show that the output vectors 
in column 1 are a subspace of the space of all output vectors. This sug- 
gests that the output vectors in column 1 can be coded over n compo- 
nents setting the remaining I — n components to zero (that is, code 
over the subspace only) . 

The upper submatrix of the partitioned C matrix. 



[fe] 



(C n is an n X n matrix) 



can be determined by considering the outputs associated with the 
independent coded state vectors. Then, 

C n [Vi | • • • | v n ] = [w' n | • • • | <J 

where the w' are n component vectors. Recalling that [vj | . . . [ v n ] 
= I n (for convenience in the state coding process) leads to 



* Colin and Even 1 
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c m = k i • • • i «a 

Since the subspace property of the first column must be preserved, 
it is true that C,_„ is the n X I — n null matrix. Furthermore, C„ and 
the code assignment over n components can be determined by designat- 
ing n independent output vectors in conjunction with the state derived 
equations and outputs sums. 

For all columns which are premutations of the first column, the 
corresponding Du a must have zero as components I — n through / 
(again, to preserve the subspace property). More generally, the 
entries in the first n components of Du x generate permutations of the 
first column, while the entries in the remaining I — n components force 
the output vector out of the n dimension subspace.* 

In order to code the output vectors which are not members of the 
first column, notice that an output sum which involves such a column 
and the first column has N distinct sums and 2N vectors. N of these 
vectors have been coded (the members of the first column) and one 
of these vectors appears in each sum of vectors in the output sum. 
Therefore, if a linearly-independent vector is designated, by assigning 
a nonzero entry in I — n components, then all of the remaining iV — 1 
vector codes are determined. 

For example, if, in equation 33, x = 1, then Wix, for i = 1, 2, . . . , 
N are vectors in the subspace (and can be coded), then setting w lv 
equal to a linearly-independent vector or any vector not in the sub- 
space gives the code assignment for all other vectors in column y 
since w iy = w ly + w ly + w^ for any i. The procedure is basically the 
same as in coding state vectors of a singular system. 

The case where L ^ N can be treated as an obvious special case of 
the above. 

4.2 Tlie Moore Model 

In the Moore model of a sequential machine the output is a func- 
tion of the system's state alone. That is, D = 0. It is then obvious 
from equation 32 that the number of distinct output vectors cannot 
exceed the number of state vectors. Therefore, the method for coding 
over the n-dimensional subspace introduced in Section 4.1 can be 
applied directly, using the state-derived equations. 



* This property is the identity or disjointness of sets of vectors which can be 
rigorously proven by an argument parallel to the proof of theorem 3. 
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V. CODING THE INPUT VECTORS 

5.1 Tfw Mealy Model 

In the Mealy model of a sequential machine it is possible to have 
inputs which do not generate distinct columns in the state transition 
table and yet give rise to distinct output columns. Such cases require 
an interaction in the determination of the B and D matrices. 

Let there be M different inputs, and K(K g 2*) distinct columns 
in the state transition table. Take one input as the null input, say 
Ul = 0. Considering one component sum from each state sum, it follows 
that 

Bu x = v xl + v lx 

for each u x that generates a distinct column. For convenience number 
such inputs u x through u K . Similar to the approach of Section 4.1, 
code the input vectors over the first k components. That is, from 

B = [B k | B m -k] (where B k has k columns) 
select 

B k = [»» + »ia | • • • I i>n + »i.*+JM I • • ' I Wt+J" 1 ! (34) 

where the u' arc linearly independent vectors formed by the first k 
components of the input vectors, and where Vu + Vu, . . . , Vu + 
Vi.fe+i are the k vectors that span the set of the K distinct sums 
of the form v u + v lx . Since it is only the first k components of the 
input vectors that influence the state transitions, it must be true that 
B m - k is the n X (m — k) null matrix. The remaining k component in- 
put vectors can be obtained by solving the set of linear equations* (in 
matrix form) 

B k u'„ = v u + v lv . 

At this point k components of all input vectors have been coded. 
Considering the output table, the D matrix can be determined from 

D[u a | • • • | u r ] = [w u + w la | Vu + W lh | • • • | Vu + w ir ] (35) 

where the columns of the matrix on the right side span all sums of 
the form Wu + w iy) and where u a , . . . , u r are m inputs which are 
assigned as linearity independent vectors. 



♦These linear equations must be consistent since the columns of B k span all 
vectors of the form vn + ih ¥ . (See equation 34.) 
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Consider the example in Table X. 

Table X 

«i U 2 M a U 4 U 5 lit Uj U H 

8] sjz, sjz 2 Sj/zs sjz,-, s 2 /z 7 s 2 /z» s 2 /z s 2 /z i0 

5 2 S 3 /z 2 S 3 /z x s 3 /z n s 3 /z- a s 4 /z H s 4 /z 7 s 4 /z u> s 4 /z 9 

5 3 s 4 /z 3 s 4 /z 4 s 4 /z n s 4 /z l2 s 3 /z 13 s 3 /z 14 8 3 /s 1B s 3 /z in 
s 4 s 2 /z 4 s 2 /z 3 s 2 /z 12 $ 2 /z n sjz 14 Sj/z l3 Sj/z ie 8,/a, fl 

In order to code the system states, consider U\ and u 8 which generate 
the only distinct columns. Take U\ = 0. It can be verified that an 
acceptable coding is 



v, = 



Vo = 



r, = 



giving 



A = 



1 1 
1 



For the output table, L = 16, Z = 4. Calculating the upper partition 
of the C matrix, C-> , 

C 2 [v* | ('2] = [w' 3 I w' a ], 
or 

C 2 = [w' 3 \w 2 ]. 
Take 



■w< 



Wo = 



then, C 2 = I 2 or 



C = 



[~1 








1 








_0 


oj 
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From the state sum, w' 4 = (J, and since 0, = 0, it follows that w[ = 

Clearly, w x , w a , w» , and w A are given by including two additional 
components. In order to code column 3 consider the output sum 

U'l + W 5 = W a + t» a = w* + w u = w A + w ia . 
Taking w 3 = 



0- 

zero 



leads to 



w« = w, + to* + w 2 = 



Similarly, 



w>, = 



By taking 



w 7 = 



the remaining output vectors can be coded. 

Coding the first component of the input leads to 

rv 



B % = 







With the results 



B = 



'l n 



and 



_0 Oj 

u[ = U' 2 = W3 = U[ = 0, 
It* = Uq = U' 7 = U's = 1. 





















V 2 = 






+ 


1 

1 T 


= 


1 
1 









0. 


o, 







fl 1 




1 

1 ' w »= 1 


• 


0. 




o] (( 


) 


. ( 
and w„ = 


) 


1 















(36) 
(37) 
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The output vectors w 2 , w B , and w 7 span all sums of the form w, + w m 
(notice w t = 0) x = 2, 5, 6, 7, 8, 9, 10. Then, 



D[u 2 | m 3 I w s ] = [w 2 I «J 5 I w 7 ] = 



Considering equations 36 and 37, make a linearly-independent assign- 
ment of u 2 , u z , and w fi . Say 



r° 





ol 


i 











1 











lj 



U; = 



M s = 



, and u 5 = 



which leads to 



D = 



To determine u 4 , for example, set up the linear equations 
Du 4 = »•„ (recall u' 4 = 0) 


















1 





1 


(J 


1 





()__ 



[~0 o' 




'() 


1 


u 4 = 


1 


1 




1 


1 Oj 








or 



Us = 




1 
1, 



Similarly, 



U,x = 



u- = 



1 
1 




, and u 8 = 
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5.2 The Moore Model 

For the Moore model all columns of the state transition table are 
distinct; therefore, the method for coding over k components of u, 
introduced in the last section, can be applied directly. 

VI. LINEARITY AND INCOMPLETELY SPECIFIED SYSTEMS 

This section considers the problem of specifying "don't care" entries 
in the state transition table in a way consistent with linearity; the 
results can be extended to the output table. 

It is obvious that if an incompletely specified table is to have a 
linear realization, then the entries in the table must obey the same 
relationships which were developed in the preceding sections. For 
example, the table must exhibit consistent state sums, and allow 
completion of the maximum memory process. The resulting restric- 
tions on the unspecified entries may be used to deduce their appro- 
priate assignments. 

Consider Table XI in which the "don't care" next states are de- 
noted by the symbol t. 





Table XI 









1 


St 


«, 


s 2 


s 2 


s 4 


s 8 


s 3 


•S S 


U 


St 


S a 


Si 


Sa 


s 3 


Si 


So 


8j 


s a 


s~ 


u 


Sa 


s s 


t. 


So 



The state sum is 

v 2 + h = Vi + v<s = U + v s = v t -{- v 3 = t 2 -\- Vg = t 3 + v 5 . (38) 
From the third and fifth terms, it follows that U = t 2 . Forming 

A(vi + v 3 + v 4 + i> 6 ) 



leads to 

Also, 

yields 
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"o + v, + v B + U =0. 

A(y 4 + i'„ + v 2 + O 

v a + «i + w 4 + 2, = 0, 
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(39) 



where l y = At t . Locating v , v y , and v t in the state sum leads to the 
conclusion l x = v 3 . The present state which gives s a as its next state 
under zero input is s 5 . So that, £, = v 6 . The first and last terms of the 
state sum imply that t 3 = v 2 . From A (y 4 + v G + y 8 + fe) obtain 

»fl + Vi + ^3 + ?2 = ^6 + fi + v 2 + ? 2 = 0. 

Adding the last equation to equation 39 gives 

v a + U + v 2 + 2a = w 8 + ^5 + ^2 + k = 0. 

However, equation 38 indicates t 2 + v 8 = v 2 -\- v 5 ; so that i 2 = t 2 . From 
the table, t 2 = v 7 . Table XII shows the fully specified table. 



T 


ABLE XII 









1 


Si 


s 6 


s 2 


S 2 


8* 


s« 


Sa 


s 8 


s 7 


8 4 


s e 


s 4 


S S 


s 3 


Si 


8„ 


s, 


s 3 


s 7 


s 7 


S 8 


s 8 


8 2 


S 5 



APPENDIX 

^4n. Addition to Theorem 2 



For iV not equal to 2" there is a set of 2" — N vectors that cannot 
be used as state vectors, However, when the system is linear operaf- 
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ing on any unused vector with the A matrix, and adding Bu z must 
produce a vector which is also an unused vector. If this were not 
the case, there would exist a state vector which would give rise to 
one of the unused vectors as a next state for some input. It follows 
that a transition table can be constructed containing only the 2* — N 
unused vectors. Let this system be called a virtual system. From the 
foregoing, it is clear that the states of the virtual system must obey 
the restriction of Theorem 2; that is, the number of distinct inputs 
cannot exceed 

2 + (2" - N) 2 2 1 "'', 

»-2 

where t is as before. Since the virtual and original systems must re- 
main disjoint, the original system must observe the bound. This is a 
smaller upper bound than obtained in Theorem 2. 
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